Parameter-tuning Networks: Experiments and Active Walk Model 
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The tuning process of a large apparatus of many components could be represented and quantified 
by constructing parameter-tuning networks. The experimental tuning of the ion source of the neutral 
beam injector of HT-7 Tokamak is presented as an example. Stretched-exponential cumulative 
degree distributions are found in the parameter-tuning networks. An active walk model with eight 
walkers is constructed. Each active walker is a particle moving with friction in an energy landscape; 
the landscape is modified by the collective action of all the walkers. Numerical simulations show that 
the parameter-tuning networks generated by the model also give stretched exponential functions, in 
good agreement with experiments. Our methods provide a new way and a new insight to understand 
the action of humans in the parameter-tuning of experimental processes, is helpful for experimental 
research and other optimization problems. 
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Large apparatuses pay more and more important role 
in the experimental research of modern physics, such as 
the high-energy accelerators and controlling nuclear fu- 
sion devices. A large apparatus made up of many compo- 
nents, each component needs be tested and tuned sepa- 
rately and then collectively, before experiments using the 
apparatus as a whole can be conducted. And there are 
a large number of parameters to be tuned. The parame- 
ter tuning processes are often complicated and onerous, 
strongly depend on the the experience of experimenter. 
How can we model the adjustment process of these pa- 
rameters and make some sense out of it? 

For example, in a Tokamak in plasma physics, in the 
ion source segment of the neutral-beam injector system 
alone, there are eight major parameters to be adjusted. 
The experimenter sets the parameter values, turns on the 
equipment, and measures the outcome of a certain quan- 
tity Q. If the Q obtained does not meet the mark Qq, say, 
the whole process is repeated, with a new set of param- 
eters. The adjustment process stops when Q is equal or 
very close to Qq. The simultaneous adjustment of a large 
number of parameters is a complicated process, which is 
based on the feedback from previous Q values obtained, 
the experimenter's experience, and the limitation of the 
hardware that control the parameters. 

To quantify this complicated process, a parameter- 
tuning network can be constructed as follows. Assume 
that N parameters Ui(i = 1, 2, • • • , N) are involved. The 
experimenter's serial adjustment of u [= (ui,-- - ,Ujv)] 
can be represented by a sequence of connected dots in 
the A^-dimensional u space. For each choice of u, Q is 
measured, so that Q = Q(u) but the functional form is 



unknown due to the complexity of the equipment, which 
is like a black box. 

The sequence of u dots is then projected onto the 
{ui,U2} plane, say. The dots on the same vertical line 
along the U3 direction are allowed to collapse to one point, 
called a node. A line connecting two nodes is called an 
edge [J [H, [H . Since in real situations, the parameters se- 
lected by the experimenter in different adjustments may 
partially overlap with each other, there may be more 
than one edge connecting two nodes. These edges are 
directed. For simplicity, we make the approximation of 
collapsing all the edges between two nodes that have the 
same direction as one single edge with the same direc- 
tion. Consequently, between two nodes, there are at 
most two edges with opposite directions, resulting in a 
directed parameter-tuning network. A non- directed net- 
work is formed from the directed one, by collapsing all 
the edges between any two nodes and removing the di- 
rections. 

In a parameter-tuning network, there are N n nodes, 
say. For a directed parameter-tuning network node j (j — 
1,2, • • • , N n ), let N + (j) be the number of in-going edges, 
N-(j) the number of out-going edge. 

Now count the number of N + that has the value k, 
and call it p + {k); similarly for p^(k). The corresponding 
function in the non-directed network case is denoted by 
p(k). k is called the "degree" of a node. p+{k) is called 
the "in-degree distribution", p-(k) the "out-degree dis- 
tribution", and p(k) the "degree distribution." Next de- 
fine the corresponding " culmulative degree distributions" 
P+(k), P-(k) and P{k) by 
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FIG. 1: The non-directed parameter network on the ( U, I) 
plane derived from the experimental data, where U is the 
working voltage of the cathode gas valve and / the filament 
current. 
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Here k m is the maximum k that the p function is non- 
zero, and all of the distribution functions are not unitary. 
Note that by definition, the P's are monotonic decreasing 
functions, while the p's may not be monotonic at all. 
The reason for introducing the P's is that we want to fit 
them to monotonic decreasing functions such as stretched 
exponents or power laws. 

In our experiments studying the ion source of neutral 
beam injector system for HT-7 Tokamak, eight control 
parameters are involved (N = 8). These include the fil- 
ament current, magnet current, arc voltage, cathode gas 
valve voltage, anode gas valve voltage, etc. Each of the 
parameters has 10 to 30 discrete, adjustable setting val- 
ues. The aim of the experiment is to find out which 
set of parameters will give a strong and stable discharge, 
measured by the arc current intensity Q. Each param- 
eter is set by a dial which can be turned left or right 
between two extreme positions. When the extreme po- 
sition is reached, the experimenter has to turn the dial 
back, reversing the direction of turning. 

From our experimental data, the sequence of param- 
eters in the 8-dimensional u space is first generated 
and the corresponding directed and non-directed tuning- 
parameter networks are constructed. The non-directed 
network is shown in FIG. 1. The P's are obtained, and 
fitted nicely with stretched exponential functions (FIG. 
2) such that 







a = 1.96 




b = 6.69 




y= 0.5 


• > - 




•5C 



4 V. 


■ i 1 


a = 2.60 




b = 8.06 




r=o.4 





1.0 



1.5 



2.0 



2.5 



3.0 



k r 



FIG. 2: Experimental curves of P+{k), P-(k) andP(fc), fitted 
to stretched exponent functions. The corresponding (directed 
and non-directed) parameter-tuning networks exist on the ( U, 
I) plane, where U is the working voltage of the cathode gas 
valve and / the filament current. Its non-directed structure 
has been shown in FIG. 1. The experimental data obtained 
from the tuning of the ion source in a whole experiment sea- 
son, the sequence includes 789 parameter sets. 



or, equivalently, 



lnP(fc) = -ak? + b 



(5) 



P(k) ~ exp(-aF) 



(4) 



and similarly for P+(fc) and P_(fc). Such property is also 
found in the parameter-tuning networks derived from the 
data of the tuning experiments in other experiment sea- 
son of the ion source (each of them includes 600 to 800 
parameter sets). 

The experimental adjustment of the parameters is 
somehow correlated by the experimenter, and the process 
can be modeled by an active walk (AW) model [4| . In our 
AW model here, N = 8; each m has adjustable values of 
1, 2, • • • , 20, say. The adjustment of the ith parameter is 
represented by the movement of an active walker on a ID 
landscape potential Vi(xi). The allowable x\ for the ith 
walker are the integers (1, 2, 3, ■ ■ • , 100), the same for all 
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FIG. 3: Sketch of possible subwalks of a particle. The solid 
dot, gray dot and open circle represent the initial position, 
finial position and some intermediate position of the particle, 
respectively; the arrow indicates the initial direction of the 
particle, (a) The particle moves and stops on a plateau, (b) 
The particle gets over a low potential barrier or a shallow 
well, (c) The particle stops in a deep well, (d) The particle 
rebounds on a high potential barrier, (e) The particle moves 
on a general landscape, and ends up in a deep well after many 
steps. 



i. These 100 numbers are mapped to the Ui, such that if 
the zth walker ends in the region [1, 5] on the xi axis, Ui 
will assume the value of 1. Similarly, the region of [6, 10] 
is mapped to Ui = 2, etc. This mapping can be attained 

by 



u i {t) = Int[{X i {t) -!)/$) + I 



(6) 



where Xi(t) is the position of the ith walker on the Xi 
axis at time t, and Int means taking the integral part of 
the number. This mapping of Xi to Ui has the effect of 
making two consecutive sets of adjusted parameters more 
likely to partially overlap with each other, and ensures 
the occurrence of smooth Vi vs xi curves. 

In the simulations, all Vi start flat at time t = 0, 
and are updated simultaneously at each time step t(= 
1, 2, • • • ), according to a rule to be specified below. But 
between two consecutive time steps, each walker moves 
a few steps in a subwalk in its own Vi, independent of 
other walkers. In a subwalk, the walker does not change 
Vi. The subwalk is like a particle rolling on a landscape 
with friction, with the following rules (with the subscript 
i removed for the sake of clarity). The subwalk time is 
labeled by r(= 0, 1,2, •••). 

(i) . At time t — 0, the particle is arbitrarily placed on 
the x axis. 

(ii) . At time t, the particle is given energy K at r = 0. 
(Ko is a parameter fixed in the model.) 

(iii) . At subwalk time r, the particle moves left or 
right with equal probability. However, after each move, 
the particle loses energy e, and the energy difference 
V(x(t)) — V(x(t + 1)) which could be positive or nega- 
tive is added to its energy. Consequently, at time r, the 
particle already moves r steps, and its energy becomes 



K(t) =K + Vq- V(x(t)) - re 



(7) 



where Vq = V(x(0)), the potential at the initial position 
of the particle at r = 0. 
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FIG. 4: Dependence of the error function on time, from the 
eight-parameter AW model simulation. 



(iv) . The particle can get over a potential barrier in V 
that is lower than K, and can rebound if the barrier is 
higher than K. 

(v) . When the particle reaches the left boundary (x = 1) 
or the right boundary (x = 100), it reverses direction 
and continues its subwalk. 

(vi) . The particle stops when it walks into a potential 
well and cannot get out with its energy K, or exhausts 
its energy on a plateau. 

These possibilities are sketched in FIG. 3. The reflect- 
ing boundary condition in item (v) corresponds to the 
real experimental situation where a dial with a limited 
range is used. 

After all N particles stop, the time clock increases from 
t to t + 1; the particle's position at the end of its subwalk 
is taken to be X(t + 1), which is the starting position of 
the subwalk at time t+1. (The subwalks of the particles 
may not stop after the same number of subwalk steps; 
those stop first will sit there and wait for the last par- 
ticle to stop.) The landscape Vi(xi) is updated by the 
landscaping rule: 



Vi{ Xl ;t + l) = < 



( Vi( Xi ;t) + W( Xi - Xi(t + 1)), 
E(t) > E a (t); 
ViixnQ-Wixi-Xiit+l)), 
E(t) < E a (t). 



(8) 



where t = 0, 1, 2, • • • . In our numerical simulations be- 
low, the (z-independent) landscaping function W is given 
by W(0) = 4, W{±1) = 3, W(±2) = 1, and W = oth- 
erwise. In Eq. (8), the error function E(t) is assumed to 
be 



E(t) = \Q(u(t)) - Q \ 



(9) 



where u(t) is obtained from Eq. (6); E a (t) is the average 
error counting the last n time steps, given by 



Ea(t) = - Yl E ^ 



(10) 



t'=t-n+l 
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FIG. 5: Numerical curves of P+(k), P-(k) and P(k) obtained 
from the parameter-tuning networks from a eight-parameter 
AW model simulation, fitted to stretched exponent functions. 

In computer simulations, we pretend that we know Qo 
and the Q(u) function. In reality, the former is known 
to the experimenter; the latter can be roughly inferred 
from experimental data. Note that while the subwalks of 
the particles are independent of each other, the updating 
of their landscapes is affected by their collective effort 
through Q(u) in E{t). 

The eight-parameter AW model is simulated with t go- 
ing from 0, and the simulation is stopped when the opti- 
mal parameter set is gotten. The function Q is assumed 
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to be 

Q(u) = \m - 10| + \u 2 - 10j + • • • + |u 8 - 10| (11) 

The parameters used are: Kq = 23, e — 1, n = 5 and 
Qo = 0. This means that u = (10, 10, • • • , 10) is the one 
and only optimal parameter set. 

The error function E(t) is displayed in FIG. 4, which 
shows that the optimal u is first obtained at to = 3718. 
The 700 u(t) dots (with 300 < t < 1000, such number 
of u(t) is similar with the experimental data, and the 
initialization process when t < 300 is ignored) in the 
u space are projected onto the (1*1,112) plane to obtain 
the directed and non-directed networks. The correspond- 
ing cumulative degree distributions are given in FIG. 5. 
Good stretched-exponential fits are obtained, in agree- 
ment with the experimental findings in FIG. 2. 

In the AW model, the subwalks kind of mimicking the 
action of the experimenter-we think that is why the AW 
model and the experiments give similar P functions. Hu- 
man dynamics 5, 6] have been studied in other situations 
by different models. Our results imply that our network- 
based statistics and the AW model is helpful in the under- 
standing of human action in the experimental processes 
and very likely in many other optimization projects. The 
stretched exponent property of the parameter-tuning net- 
work imply the human action in the optimization process 
could be having some quantitative principles, which is 
important for the experimental studies. Stretched ex- 
ponent distributions or relations exist widely in many 
other systems 0, H, M, [HI- Since AW- like dynamics is 
very common in nature [4| , our model may reveal a new 
mechanism of stretched exponent distribution. By modi- 
fying the subwalks and tuning their parameters one may 
shorten to, the shortest time to find the optimal param- 
eters, which would be of interest to the experimental re- 
searchers. Finally, the AW model mimics an optimiza- 
tion process in real experiment, could be useful in the 
optimization projects in many other systems. 
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